#html parser

[warbyfromtechsupport]

I just figured out how to make a search term parser so I can add tags to my games site :D

I hate ai

so I did a thing yay

At 14

feel proud of me

please

[roksik-dnd]

For everyone who asked: a dialogue parser for BG3 alongside with the parsed dialogue for the newest patch. The parser is not mine, but its creator a) is amazing, b) wished to stay anonymous, and c) uploaded the parser to github - any future versions will be uploaded there first!

UPD: The parser was updated!! Now all the lines are parsed, AND there are new features like audio and dialogue tree visualisation. See below!

Patch 7 dialogue is uploaded!

If you don't want to touch the parser and just want the dialogues, make sure to download the whole "BG3 ... (1.6)" folder and keep the "styles" folder within: it is needed for the html files functionality (hide/show certain types of information as per the menu at the top, jumps when you click on [jump], color for better readability, etc). See the image below for what it should look like. The formatting was borrowed from TORcommunity with their blessing.

If you want to run the parser yourself instead of downloading my parsed files, it's easy:

run bg3dialogreader.exe, OPEN any .pak file inside of your game's '\steamapps\common\Baldurs Gate 3\Data' folder,

select your language

press ‘LOAD’, it'll create a database file with all the tags, flags, etc.

Once that is done, press ‘EXPORT all dialogs to html’, and give it a minute or two to finish.

Find the parser dialogue in ‘Dialogs’ folder. If you move the folder elsewhere, move the ‘styles’ folder as well! It contains the styles you need for the color coding and functionality to keep working!

New features:

Once you've created the database (after step three above), you can also preview the dialogue trees inside of the parser and extract only what you need:

You can also listen to the correspinding audio files by clicking the line in the right window. But to do that, as the parser tells you, you need to download and put the filed from vgmstream-win64.zip inside of the parser's main folder (restart the parser after).

You can CONVERT the bg3 dialogue to the format that the Divinity Original Sin 2's Editor understands. That way, you can view the dialogues as trees! Unlike the html files, the trees don't show ALL the relevant information, but it's much easier to orient yourself in.

To get that, you DO need to have bought and installed Larian's previous game, Divinity Original Sin 2. It comes with a tool called 'The Divinity Engine 2'. Here you can read about how to unstall and lauch it. Once you have it, you need to load/create a project. We're trying to get to the point where the tool allows you to open the Dialog Editor. Then you can Open any bg3 dialogue file you want. And in case you want it, here's an in-depth Dialog Editor tutorial. But if you simply want to know how to open the Editor, here's the gist:

Update: In order to see the names of the speakers (up to ten), you can put the _merged.lsf file inside of the "\Divinity Original Sin 2\DefEd\Data\Public\[your project's name here]\RootTemplates\_merged.lsf" file path.

Feel free to ask if you have any questions! Please let me know if you modify the parser, I'd be curious to know what you added, and will possibly add it to the google drive.

[valeriehalla]

mwah mwah mwah mwah mwah I just found your VN and it's so cute and arresting and so full of nonbinary longing I'm absolutely in love already and it's kinda inspiring me to do the scary job of opening up a word doc and try writing some of my own stuff for the first time ever

also wrt aster i love love love love love the idea of being freed from agab. just... can't remember. who cares. no longer having to measure up to a gender metric or constantly minimizing your male shoulders or female hips and worrying about your ratios or presentation - and just relax and enjoy it instead of treating it like a constant chore of maintaining a dozen spinning plates to avoid being "found out". freed from presentation pressure. mwah.

also also as a fellow web developer I'd love to hear more about your stack for ssg - gatsby? svelte? vite? 93 nested imported html docs? one really really big div? I ask because while I don't know if I'll ever have the chops for music production, reading and discovering that inline music player absolutely tickled me, both narratively and as a developer, what a delight, so so so good

My “stack” ... hmmm. “Stack” .................

So, for the main website I just used “Lektor”, which I picked out of a hat on the basis that it was python-based and could do the one thing I cared about (HTML templating). But the CURSE/KISS/CUTE reader is coded from scratch. It is a single-page app, and it loads and displays story content by grabbing the HTML from a JSON file I call the “story file”. The JSON in turn is created by a parser that I wrote in python that parses a specially-formatted markdown file which I also confusingly call the “story file”. The script format for this latter file is slightly custom but is mostly just “normal markdown but I repurposed code ticks as a macro format”:

The music player is pretty rudimentary and just offloads all the complicated business to howler.js.

It’s a funny patchworked leaning tower of python but it gets it done and gets it done entirely client-side and that means I don’t have to dip even one of my toes into the haunted pool of server-side web development =w=

[trainsinanime]

I've finally fixed trainsingames.com, so you can now actually read the things I wrote there, see the screenshots and so on. Just to be clear, this isn't my best work, it's all from 2013 or earlier, I'd definitely do and say things differently now, but hey, I still made it, and I don't want to see it gone.

The site is basically archived. I have no plans to write anything more for it at the moment. Never say never, of course, but given how few games I played over the past years, I don't really see it happening, sorry.

(I also have no plans to open it up to others, sorry, because that's something I'd need to manage, I'd probably need to install a proper CRM and so on, and I just don't have the time or energy for that among all my other hobbies.)

On the website front, I may do some changes, just to make it look nicer, but there's no set time frame for that. I also want to change it to a system where the site is just static HTML that gets regenerated from PHP when I update it (or something like that) to avoid any issues like this one in the future. For the record, the problem was that the Markdown parser I had from ~2007 didn't work with modern PHP versions, so I finally updated it.

And yes, I made trainsingames.com long before this blog, that's where I got the idea for this URL from.

[utopicwork]

The html editor work will include a parser to load existing pages, this work will eventually lead to reinterfacing work where we'll be able to take existing web pages and parse them into optimized native user interfaces that exclude bloat

[zarvasace]

Things I've learned about AO3 styling recently

It's rather difficult to work around the existing default styling of things like <p> and <h#>s. Better to use <div>s to circumvent that entirely.

If you use <p> and <div> elements in the same block, the <div> will inherit the <p> because AO3 puts freakin <p>s on EVERYTHING

^^ you don't need to add extra padding or margin on stuff a lot because of the existing margins on <p>s which, as we have noted, go on everything thanks to AO3's parser. Just keep it in mind.

ID css selectors don't work. Use classes instead.

AO3 doesn't really style lists or tables, so you can use those selectors without working around anything

Selectors like :nth-child still work though!!

Just keep your nesting organized and save your work somewhere where the tab stops and formatting makes sense, because AO3's html editor likes to move stuff around and it's hard to find after the fact. Keep a copy for editing.

[cssscriptcom]

Parse Markdown, HTML, and CSS with very-small-parser Library

very-small-parser is a lightweight (~4kb) dependency-free JavaScript library for parsing Markdown, HTML, and inline CSS in your web project. It can be helpful in applications that require dynamic content rendering, content analysis, or text manipulation. For instance, you can build a custom Markdown previewer, a blog engine, or a tool that sanitizes user-generated HTML. You can also use it to…

[jihnari]

ao3 updated their tags parser 😭 even when im not writing html i suffer

[poseidonsworst]

Twine is AWESOME you don't need to know any coding to make a game! There are macros you can learn to do more things, and if you know html or css you can make it pretty.

But I wanted to throw in a few Interactive Fiction recommendations!!

With Those We Love Alive by porpentine (also the author of the amazing article Hot Allostatic Load and you should read it if you haven't already!) Her entire body of work is awesome, they're a master of IF as a medium and a genre. WTWLA changed my whole writing style when I was young, and is still a huge influence of mine to this day. I come back to it every four to five years to meditate on how I've changed. Bonus game: Howling Dogs

You play as an artificer unable to dream, charged with creating treasures for the Empress. Explore, breathe, and add to Porpentine's vast collection of arms.

Midnight. Swordfight. is my second recommendation. It's fun, trippy, humorous, and NSFW at certain Unexpected points (mind the polarbear). The Countess has thrown down her glove, and you have until midnight to prepare for the duel!

Galatea by is a parser unlike any other in my opinion. From the site: A conversation with a work of art. "47. Galatea. White Thasos marble. Non-commissioned work by the late Pygmalion of Cyprus. (The artist has since committed suicide.) Originally not an animate. The waking of this piece from its natural state remains unexplained."

Colossal Cave Adventure: This you should play for the history of it! Will Crowther made it based on his experinces in Mammoth Cave, the longest known cave system in the world! He made it for his daughters, and it's maybe one of the first text based games ever made and certainly the first popular one.

Violet: (I'm getting tired and starting to remember less and less about the games I've played) from the site: "Calm down. All you have to do is write a thousand words and everything will be fine. And you have all day, except it's already noon."

Photopia: "Will you read me a story?"

"Read you a story? What fun would that be? I've got a better idea: let's tell a story together."

Queers In Love At The End of The World: exactly what it says on the tin, how will you spend your final ten seconds on earth?

Depression Quest: If you've only heard of this in the context of its creator being harassed by gamergate you're missing out on an incredible portrayal of what it's like to live with depression.

The Uncle Who Works For Nintendo: "You are 11 years old. You are sleeping over at your best friend's house. You and your friend like videogames. Your friend has a lot of cool games. And, believe it or not, an uncle who works for Nintendo. And he's coming to visit at midnight. A narrative horror game. Five endings."

My Father's Long Long Legs: "An interactive horror story about family, unease, and loss."

I really wanna recommend this incredible twine game that told its story from two different perspectives, told side by side with black text on white on one side and white text on black on the other, but I can't for the life of me remember what it's called!! If anyone knows of what game I'm talking about and can find it I'll be eternally grateful.

My last recommendation is one I've already sent you to! I highly suggest you click around and explore the Interactive Fiction Database for lots more!

i think the near-extinction of people making fun, deep and/or unique interactive text-based browser games, projects and stories is catastrophic to the internet. i'm talking pre-itch.io era, nothing against it.

there are a lot of fun ones listed here and here but for the most part, they were made years ago and are now a dying breed. i get why. there's no money in it. factoring in the cost of web hosting and servers, it probably costs money. it's just sad that it's a dying art form.

anyway, here's some of my favorite browser-based interactive projects and games, if you're into that kind of thing. 90% of them are on the lists that i linked above.

A Better World - create an alternate history timeline

Alter Ego - abandonware birth-to-death life simulator game

Seedship - text-based game about colonizing a new planet

Sandboxels or ThisIsSand - free-falling sand physics games

Little Alchemy 2 - combine various elements to make new ones

Infinite Craft - kind of the same as Little Alchemy

ZenGM - simulate sports

Tamajoji - browser-based tamagotchi

IFDB - interactive fiction database (text adventure games)

Written Realms - more text adventure games with a user interface

The Cafe & Diner - mystery game

The New Campaign Trail - US presidential campaign game

Money Simulator - simulate financial decisions

Genesis - text-based adventure/fantasy game

Level 13 - text-based science fiction adventure game

Miniconomy - player driven economy game

Checkbox Olympics - games involving clicking checkboxes

BrantSteele.net - game show and Hunger Games simulators

Murder Games - fight to the death simulator by Orteil

Cookie Clicker - different but felt weird not including it. by Orteil.

if you're ever thinking about making a niche project that only a select number of individuals will be nerdy enough to enjoy, keep in mind i've been playing some of these games off and on for 20~ years (Alter Ego, for example). quite literally a lifetime of replayability.

[rossk]

How DC Tech Events works

The main DC Tech Events site is generated by a custom static generator, in three phases:

Loop through the groups directory and download a local copy of every calendar. Groups must have an iCal or RSS feed. For RSS feeds, each item is further scanned for an embedded JSON-LD Event description. I’ll extend that to support other metadata formats, like microformats (and RSS feeds that directly include event data) as I encounter them.

Combine that data with any future single events into a single structured file (YAML).

Generate the website, which is built from a Flask application with Frozen-Flask. This includes two semi-secret URL’s that are used for the newsletter: a simplified version of the calendar, in HTML and plaintext.

Once a day, and anytime a change is merged into the main branch, those three steps are run by Github Actions, and the resulting site is pushed to Github Pages.

The RSS + JSON-LD thing might seem arbitrary, but it exists for a mission critical reason: emoji’s! For meetup.com groups, the iCal feed garbles emojis. It took me some time to realize that my code wasn’t the problem. While digging into it, I discovered that meetup.com event pages include JSON-LD, which preserves emojis. I should probably update the iCal parser to also augment feeds with JSON-LD, but the current system works fine right now.

Anyone who wants to submit a new group or event could submit a Pull Request on the github repo, but most will probably use add.dctech.events. When an event or group is submitted that way, a pull request is created for them (example). The “add” site is an AWS Chalice app.

The newsletter system is also built with Chalice. When someone confirms their email address, it gets saved to a contact list in Amazon’s Simple Email Service(SES). A scheduled task runs every Monday morning that fetches the “secret” URL’s and sends every subscriber their copy of the newsletter. SES also handles generating a unique “unsubscribe” link for each subscriber.

(but, why would anyone unsubscribe?)

[bluelupinblogs]

Web Scraping Frameworks Compared: Scrapy vs. BeautifulSoup vs. Puppeteer

Ever wondered which web scraping tool is best for your next project? 🤔 Our latest infographic breaks it all down—comparing Scrapy, BeautifulSoup, and Puppeteer based on speed, ease of use, flexibility, JavaScript rendering, and more.

✨ Whether you're a beginner looking for a simple parser or a pro dealing with dynamic content, this quick comparison will help you choose the right tool for the job.

📊 From lightweight HTML parsing to full-blown headless browsing, we’ve got it covered.

👉 Check it out and find your perfect scraping partner!

[fromdevcom]

Hypertext Preprocessor, commonly known as PHP is a general purpose scripting language which has occupied the premier spot in the web development industry. It can be easily embedded into HTML which means you need not write long code as in C programming or Perl (like defining main in C, etc.) to output something. PHP is a server-side programming language. The code is executed on the server and output is generated into HTML. The HTML output then goes to the client or a browser. So, the client receives the output without knowing the underlying code. Thus, it provides enhanced security as compared to client-side scripting languages. PHP code starts with . The PHP parser does not execute anything outside this code. Thus, a PHP file may have mixed content which has opened a lot of possibilities in the field of web development. Here are some of the reasons why PHP is immensely popular in the web development: 1. It Is A Free Platform Being an open source platform, PHP is in quite an advantageous position. Also, it is an elegant platform for newbies allowing them to test their skills and learn the dynamics of the web development industry. Since the language is free to all, it is a cost-effective alternative for over the proprietary applications as well as eliminates the legal issues. With this powerful scripting language, newcomers can enter the market quickly making space for new ideas and skills. 2. Easy To Learn And Start With PHP is quite simple; even a non-programmer can learn the basic coding skills in just a few hours. Most web developers acquire basic knowledge in HTML, making working on PHP an easy affair. Considering the learning aspect, other languages like Java, Python, etc. require an understanding of the commands, libraries, and Object-oriented programming concepts. However, in PHP, you simply need to learn a few syntax, and you can start practicing in minutes. PHP also has plenty learning resources available that make your life easier. Some of the popular learning resources are listed down below PHP Books - For beginners who like to pick a book should use these recommended PHP books.  PHP Tutorials Online - There are tons of PHP tutorials available for free. We have listed some of the good tutorials on this page. Beginners Interactive Learning Resources - These websites are absolutely awesome for beginners. They offer interactive learning for PHP programming as well.  3. PHP Is Flexible One might call PHP amateur, but it’s the result that matters. PHP is dynamic in nature, offering programmers with the ability to approach their problems with every possible solution. Facebook runs on PHP. To meet their emerging demand, they developed a derivative language known as Hack. That shows the flexibility of PHP. You can meet almost all programming requirement using PHP. 4. PHP Is User-friendly No doubt PHP is the first love for any web application developer. While other scripts require the programs to be compiled before reaching the execution stage, a PHP script does not ask for compilation. It is a simple 3 step process; Code, upload and watch. As simple as it may get, just write the script, upload it to the web server and witness the output on your browser. 5. A Huge Standard Library Collection A language’s libraries can make a whole lot of difference. Libraries are a pre-coded set of instructions that aids communication between different platforms or applications, in turn simplifying the execution process and enhancing the processing speed of a language.  With its ability of HTTP fetching, URL parsing, and supporting database drivers, the PHP libraries allow the language to work much higher efficiency. Compatible libraries allow the websites to load quickly, providing a pleasant user experience. After all, no one would like to sit back waiting for a website to load, especially when they are desperate to use the site. 6. Most Of The Top Web Applications Are Built In PHP Popular web applications like the Wordpress, Joomla, Drupal, etc.

are written using the PHP script. What makes this language so loveable is its scalability and robust architecture.  One of the major advantages of using PHP or its application is that you can update the website without rebooting the server. So, write or update the code and upload the file to the server and the changes will be effective immediately. 7. It Works With Diverse Range Of Platforms One’s ability to adapt and merge with the crowd makes them a favorite. PHP’s diversity with platforms makes it a desirable choice. This allows the developer to integrate the website on multiple platforms. Furthermore, an application written in PHP can be integrated with MySQL and Apache quickly without any limitations. 8. More Than 80% Of The Sites Are Built In Php   So Good Job Prospects With the language expanding, occupying the internet; most of the internet traffic is operating on the PHP script. More and more websites are being added to this, and almost all of them are running on PHP. So, there is demand in the market; thus, the job prospects are good for a PHP programmer. Professionals with no background in technology find it easy to learn PHP and build an outstanding career in the IT sector. Availability of an adequate number of professionals encourages businesses to create websites and applications in the PHP due to the availability of easy and affordable technical support & maintenance. And the cycle continues. 9. Cost Effective Hosting Plans Not all businesses and programmers can afford to invest a lot into website development and maintenance. With PHP offering an open source platform, and cross-platform functionality, hosting a website got a lot cheaper. Almost all web servers can host PHP applications.  Furthermore, the scripts being efficient and fast acting, maintenance costs dropped as well. 10. Lot Of Extensions And Add-ons Are Available Like any other open source platform, PHP has been subjected to many experiments by the sharpest brains that have resulted in the introduction of a lot of useful features. Programmers have created many libraries, extensions, and add-ons to simplify the coding process and enhance productivity.  Thus, you can add great features and functionality to an application simply by using the existing add-ons. Conclusion PHP is a fantastic platform to work and learn web development. It doesn’t matter if you are a professional or an amateur, a student or a business person; you can learn and use PHP to build a great web application. Not only the platform has expanded the domain of web designing, but it has also set new standards regarding ease and performance.  There are numerous possibilities and endless opportunities to grow with this powerful tool at your disposal. Anthony Bergs is a project manager at writers per hour. He always keeps an eye on the marketing sector to implement the best innovations into the strategies that he builds. He’s always open for new connections and partnerships.

[hydrus]

Version 620

windows

zip

exe

macOS

app

linux

tar.zst

Hey, I broke the manual duplicate filter in the initial v620 release on Wednesday evening. The v620a links above are now (Thursday afternoon) to a hotfix that fixes this. Thank you for the reports, and sorry for the trouble!

I had a great week. There's some fixes, some quality of life, and a bit of new tech.

For advanced users, there is a future build to test out better AVIF rendering here: https://github.com/hydrusnetwork/hydrus/releases/tag/v620-future-02

full changelog

highlights

Thanks to a user, we have some more UI quality of life improvements. The options dialog now remembers the last page you were looking at; the media viewer can now save its position on exit (useful if you use multiple); the media viewer can now be dragged around even when frameless; you can now fit the media viewer to the size of the current media; and you can put 'all my files' or 'all local files' at the top of the page selector mini-dialog (useful if you have a _lot_ of local file services). Also, you can map these new 'resize frame to media' commands, and new 'zoom to x%' commands, in the 'media viewers - all' shortcuts set.

I figured out a webp parser, and we now have correct frame timings for animated webps (they were previously locked to a 12fps fallback). All your animated webps will be scheduled for a metadata regen on update, and then they should render correct.

I added a couple of rules to JSON parsing formula: you can now test the string values of variables you parse, and you can now 'walk back up ancestors', like in the HTML parser. This means you can now filter the existence or content of a particular key or value in an Object or List and then walk back up and parse something else.

duplicates auto-resolution

I have fixed an important bug that happened when renaming rules. If you renamed some rules in the past weeks and noticed they somehow didn't always stick, you'll get a popup on update about it. The affected rules will be paused and may roll back to a previous version. Please check they are named correct and have the options you want before resuming them to semi-automatic or automatic.

Auto-resolution rules were also interrupting idle mode; I think I've fixed it.

I had a lot of success working on 'A is an exact match duplicate of B' comparison tech. I am not ready to plug it in yet, but I wrote a prototype that does some image-tile histogram comparison stats and it works to differentiate resizes/re-encodes from even minor alternates, at least on a small test scale. It needs to render both images, so it takes about 1 second to run. I am going to plug it into the manual duplicate filter as a comparison statement, and we'll tune it for wider IRL examples, and then I'll improve the auto-resolution UI to better handle laggy comparisons. I'm feeling a lot better about this--there's more to do, but it doesn't seem impossible.

next week

I may have some IRL stuff happening next week, and it is possible it will tie me up for a while, so there may not be a release for a week or two. I'll post updates when I know more. Otherwise, I'll push on this new 'A is an exact match duplicate of B' tech in the manual duplicate filter, and if the AVIF future build goes ok, that'll be folded in as well.

[utopicwork]

Wanted to test it and as it turns out it is far lighter, less complex and more generic to just have a struct representing html, js, css and build a parser to parse/render that in browser then the wasm method I was using for one file websites. I think I'm gonna switch gears to that for Microbe etc and come back to the wasm idea when wasm is better implemented